Skip to content

Update zstd from 1.4.3 to 1.4.5 #1965

Merged
merged 1 commit into from
Oct 5, 2020
Merged

Conversation

pmenzel
Copy link
Collaborator

@pmenzel pmenzel commented Oct 5, 2020

Tested on sigquit.

@pmenzel pmenzel force-pushed the update-zstd-from-1.4.3-to-1.4.5 branch from 97a806d to 3dab33b Compare October 5, 2020 14:02
@pmenzel pmenzel merged commit 3e22b66 into master Oct 5, 2020
@pmenzel
Copy link
Collaborator Author

pmenzel commented Oct 5, 2020

Benchmark on sigquit (Dell OptiPlex 7071, 8x i7-9700 @ 3.00GHz, 15.6 GB, Linux 5.4.57.mx64.340).

Versions

$ bzip2 --version
bzip2, a block-sorting file compressor.  Version 1.0.8, 13-Jul-2019.
[…]
$ zstd --version
*** zstd command line interface 64-bits v1.4.5, by Yann Collet ***
$ lz4 --version
*** LZ4 command line interface 64-bits v1.9.2, by Yann Collet ***

Test file

$ md5sum /src/mariux/beeroot/downloads/linux-firmware-20200619_p1_1a0c0c2.tar.bz2
7af8b812ce51594932086763ae3bb86e  /src/mariux/beeroot/downloads/linux-firmware-20200619_p1_1a0c0c2.tar.bz2
$ cd /dev/shm
$ cp /src/mariux/beeroot/downloads/linux-firmware-20200619_p1_1a0c0c2.tar.bz2 .
$ bunzip2 linux-firmware-20200619_p1_1a0c0c2.tar.bz2
$ md5sum linux-firmware-20200619_p1_1a0c0c2.tar
afa66c19a3d89b2c90717a8d01fd4f3a  linux-firmware-20200619_p1_1a0c0c2.tar

Compression results

$ time bzip2 linux-firmware-20200619_p1_1a0c0c2.tar

real	0m46.393s
user	0m46.284s
sys	0m0.107s
$ ls -l linux-firmware-20200619_p1_1a0c0c2.tar.bz2
-rw-r----- 1 pmenzel pmenzel 223174775 Oct  5 15:31 linux-firmware-20200619_p1_1a0c0c2.tar.bz2
$ time pbzip2 linux-firmware-20200619_p1_1a0c0c2.tar

real	0m8.386s
user	1m5.161s
sys	0m1.139s
$ ls -l linux-firmware-20200619_p1_1a0c0c2.tar.bz2
-rw-r----- 1 pmenzel  pmenzel  228821460 Oct  5 15:31 linux-firmware-20200619_p1_1a0c0c2.tar.bz2
$ time zstd linux-firmware-20200619_p1_1a0c0c2.tar
linux-firmware-20200619_p1_1a0c0c2.tar : 30.00%   (588707840 => 176636787 bytes, linux-firmware-20200619_p1_1a0c0c2.tar.zst) 

real	0m1.303s
user	0m1.377s
sys	0m0.103s
$ ls -l linux-firmware-20200619_p1_1a0c0c2.tar.zst
-rw-r----- 1 pmenzel pmenzel 176636787 Oct  5 15:31 linux-firmware-20200619_p1_1a0c0c2.tar.zst
$ time lz4 linux-firmware-20200619_p1_1a0c0c2.tar linux-firmware-20200619_p1_1a0c0c2.tar.lz4
Compressed 588707840 bytes into 307792516 bytes ==> 52.28%                     

real	0m0.669s
user	0m0.569s
sys	0m0.100s
$ ls -l linux-firmware-20200619_p1_1a0c0c2.tar.lz4
-rw-r----- 1 pmenzel pmenzel 307792516 Oct  5 15:31 linux-firmware-20200619_p1_1a0c0c2.tar.lz4

Sign in to join this conversation on GitHub.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant